Adding in Hellinger and pMSE metrics #38
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
emersodb
requested review from
amrit110,
bzamanlooy,
fatemetkl,
lotif,
masi-sh and
sarakodeiri
emersodb
commented
Sep 17, 2025
| "D104", # Ignore package level docstrings requirement | ||
| "D205", # 1 blank line required between summary line and description | ||
| "D212", # Multi-line docstring summary should start at the first line | ||
| "D301", # r-strings for docstrings with backslashes |
There was a problem hiding this comment.
This needs to be brought in if we're going to have latex in our docstrings.
bzamanlooy
reviewed
Sep 26, 2025
src/midst_toolkit/evaluation/quality/mean_hellinger_distance.py
Outdated
Show resolved
Hide resolved
src/midst_toolkit/evaluation/quality/mean_hellinger_distance.py
Outdated
Show resolved
Hide resolved
fatemetkl
approved these changes
Sep 29, 2025
src/midst_toolkit/evaluation/quality/mean_hellinger_distance.py
Outdated
Show resolved
Hide resolved
bzamanlooy
pushed a commit
that referenced
this pull request
Oct 10, 2025
04d817f Trainer: Changing all literals to enums (#48) 33f9306 Adding ignore for pip 25.2 vulnerability, removing stale ones (#50) c8d30ca Remove mkdocs build dir, add to gitignore (#49) c01121c End-to-end Evaluation Script Example (#45) d231a4a Add Nearest Neighbor Distance Ratio and Epsilon Identifiability Privacy Metrics (#42) 53e423b Adding Mean F1 Score Difference and Hitting Rate Metrics (#39) 91150fd Adding in Hellinger and pMSE metrics (#38) 746644e Tightening Ruff Configuration (#46) 580d55f Adding data_split_ratios to both the diffusion config and the classifier config (#47) 72863be Refactoring core.logger into common.logger and removing it (#41) bef53bf Train code split, Part 4: moving some of the model.py code into dataset.py (#40) 80b0154 Upgrading pip to latest version to solve security issue (#44) 83beba6 New mypy flow and fixes to typing issues that were discovered (#43) 7e77f37 Train code split, Part 3: moving some of the model.py code into sampler.py (#9) git-subtree-dir: deps/midst-toolkit git-subtree-split: 04d817f
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR Type
Feature
Short Description
Clickup Ticket(s): https://app.clickup.com/t/868fge8mt
Adding in two additional quality metrics from SynthEval to the library. These are the penultimate quality metrics to be added (just need an F1 measure in the next ticket to close off the quality measures).
NOTE: The SynthEval implementation of the Hellinger distance for numerical columns was flawed. So I brought the implementation in-house and fixed the issue.
Tests Added
A number of tests have been created to make sure the measures work as expected and produce the correct values across a number of situations.